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ABSTRACT 


Basic dynamics, sensor, control and related artificial intelli- 
gence issues pertinent to smart robotic hands for the Extra Vehicu- 
lar Activity (EVA) Retriever system are summarized and discussed. 
These smart hands are to be used as end effectors on arms attached 
to manned maneuvering units < MMU ) . The Retriever robotic systems 
comprised of MMU, arm and smart hands, are being developed to aid 
crewmen in the performance of routine EVA tasks including tool, ob- 
ject, etc. retrieval. The ultimate goal of this work is to enhance 
the effectiveness of EVA crewmen. 


INTRODUCTION 

Overview 

Manned Extra Vehicular Activity (EVA) is an important part of 
planned orbital Space Station development and operations as, e.g., 

* Initial assembly, on-going maintenance of the Space Station. 

* Maintenance and servicing - as per refueling and repair of 
satellites, platforms, and free-flyers. 

Manned EVA is also available to be used as backup to telerobotic 
systems and for unplanned or unique operations. 

Here EVA safety needs require a man-in-a-sui t retrieval capabil- 
ity. More routine needs for such things as tool and other item re- 
trieval . and assistance with workpiece/object - handling and maneu- 
verability during manned-maintenance and construction tasks, also 
require at least a low-level, dextrous and intelligent robotic 
assistant capability. 

Retriever Rationale and Background 

More specifically, during EVA operations the potential exists 
for an EVA crewman or piece of equipment to separate from or inad- 
vertently be launched away from the Space Station. Equipment failure 
or procedural error may cause such separation. Proposed Space Sta- 
tion EVA procedures require that there be at least two crewmen 
present for any EVA. However , it may not be practical because of 
safety considerations or time constraints for the second crewman 
to (a) Properly equip himself, (b) Leave the Space Station, and 
(c) Retrieve the lost equipment or rescue the first crewman who 
may be helpless. 

Figure 1 from CRef. 11 plots range versus range rate of separa- 
tion for an object which is drifting free from the Space Station. 

The initial velocity for the drifting object is 2 ft/sec in the case 
depicted. Here estimates of the position and drift rate of the ob- 
ject are indicated at the discrete data points shown. 

Table 1 summarizes these estimates of position and drift rate as 
functions of time. It indicates that at ten minutes from separation 
the object will already be 1^00 feet away and have a rate of separa- 
tion of 3.2 ft/sec. These values are 2350 ft and 5.3 ft/sec ♦respec- 
tively at fifteen minutes from separation. The results summarized in 
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Table 1 thus emphasize that time is extremely critical in initiating 
any retrieval operation. This is especially true if elapsed time and 
fuel costs are to be routinely minimized and indeed successful re- 
trieval be assured. 

Figure 2 depicts a representative trajectory for a retrieval 
scenario with an astronaut piloted Manned Maneuvering Unit <MMU) 
chasing a target. Here drift rate and time at five discrete times 
in the range from 10 to 31 minutes. Figure 2 also illustrates the 
urgency of initiating rescue as quickly as possible after separa- 
tion. 

JSC has developed the concept of the EVA Retriever, which is a 
highly autonomous, free-flying robot or robotic system. In use it 
will be on standby during EVA operations to provide the immediate 
chase, capture, and return capability required for adrift crewmen or 
station equipment. The Retriever will be used to fill the Space 
Station requirement which has been authorized by Space Station 
Control Board Directive BB000169A CRef. 13. The conceptual design of 
the EVA Retriever is depicted in Figure 3. By way of summary, Ref.l 
indicates that the Retriever is: 

* Intended to be highly autonomous 

* Capable of locating and tracking the target 

* Able to plan a path to the target and to avoid obstacles en- 
countered during the chase, etc. segment 

* Able to grapple - i.e., capture and grasp, etc. the target 
through the use of dextrous arms and hands 

* Intended to interface with the Space Station MMU - thereby 
providing commonality with the crew interface 

* Activated and supervised by voice command. 

Table 2 gives a descriptive summary of the attributes of the 
smart hand plus arm plus MMU - EVA Retriever robotic system. Here 
14 attributes ranging from principal function, environment, control 
architecture, etc. through sensors, computer processing, construc- 
tion, and power are considered. These autonomous EVA Retriever 
attributes are somewhat different from those of a space telerobotic 
system. It should be noted that this system is directed toward the 
true leveraging of an astronaut crewman during EVA. Here an analogy 
can be drawn to a shepherd with his dog(s) working a flock. A tele- 
robotic system on the other hand will occupy at least one astronaut 
crewman per system at a maximum work efficiency of 50 % of one EVA 
crewman. 

Research Work Description 

The work reported herein is part of an overall effort to inves- 
tigate the intelligent control of robotic hands on the EVA Retrie- 
ver. It has involved the exploration of basic dynamics, sensor, 
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control? and related Artificial Intelligence issues pertinent to 
robotic hands. These hands are to be used as end effectors on arms 
attached to Manned Maneuvering Units <MMU). The Retriever robotic 
systems comprised of MMU? arm and smart hands? are being developed 
to aid crewmen in the performance of routine EVA tasks including 
tool? object? etc. retrieval. The ultimate goal of this work is to 
enhance the effectiveness of EVA crewmen. 

BASIC ISSUES 

Smart? Dextrous Robotic Hands 

At this point it is important to consider the requirements (or 
desirable characteristics of typical smart robotic hands for the 
NASA/JSC EVA Retriever. Figure 4 shows a later generation version 
<4 articulated fingers - 3 fingers plus a thumb) which the Crew and 
Thermal Systems Division (CTSD) at NASA/JSC is using. As far as dex- 
trous hands are concerned? this is perhaps the best hand available 
in the world today. However? its pneumatic servo actuation system is 
impractical as far as space operations of the EVA Retriever are 
concerned. CTSD at NASA/JSC has also or will shortly have the Sal is- 
bury/JPL hand? the Jameson/Stanford hand? and the Grubbs/CTSD hand. 
These latter hands each have three articulated fingers. Along with 
the f our-f ingered Utah/MIT hand? they are being used by CTSD to ex- 
plore basic issues relevant the dynamics? sensing? and control of 
<a) the smart hands per se? and (b) the integrated smart hand plus 
articulated arm plus MMU - comprising the EVA Retriever robotic 
system. In addition? related Artificial Intelligence <AI) and compu- 
ter issues are being investigated. 

Table 2 as discussed previously summarizes the overall charac- 
teristics of the EVA Retriever, here it is seen that the dextrous 
hand/wr ist/arm system is of great importance to EVA Retriever suc- 
cess. It is important to note that the hand— wrist-arm combinations 
cover the load range typically encountered by a human arm in a 1 g 
acceleration field. 

Figure 5 shows the six different types of prehension which com- 
prise human hand grasping. These prehensions characterize the basic 
object grasp or gripping functions which humans use everyday. Here 
the six grasps can be interpreted as basic operations for smart 
robotic hands as well. 

Table 3. Summary of Manipulation Functions Ferformed_by the 

Human Hand 

1. Trigger Grip 

2. Flipping a Switch 

3. Transferring Pipe to Grip 
Using Cutters/Shears 

5. Screwing a Pen 

6. Rolling a Cylindrical Object 

7. Transferring a Pen 

8. Typewriting/Using a Keyboard 

9. Writing With a Pen 

Nine basic manipulation functions performed by the human hand 
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are summarized in Table 3. Of these manipulation functions? the 
'lower level* ones: <1) Trigger grip, (2) Flipping a switch, (3) 

Rolling a cylindrical object, (4) Transferring pipe to grip, (5) 
Screwing a pen (or a bolt-nut combination), (6) Using cutters 
/shears — are considered by the author as necessary for the EVA 
Retriever. This is especially true if the Retriever is to be used 
for assistance with a workpiece/in object handling and thereby, 
truly enhance the ef f ec t i veness of EVA crewmen. 

Humans perform grasp and manipulate functions on a routine, 
everyday basis with their five finger (four fingers plus an opposa- 
ble thumb) hands. Table ^ indicates that the six grasp and at least 
six of the manipulate functions can be performed with three or more 
fingered hands. Here each finger in multiple (three to four revo- 
ute) jointed* Figure 6 gives representat i ve plots of dexterity and 
power as functions of the type of element ( finger /hand , wrist, arm) 
combination or force level applied. These dexterity and power curves 
are composites of the maximum value portions of the curves for (a) 
Hand-f ingers , (b) Finger wrap plus wrist, and (c) Arm plus finger- 

lock combinations. The crossover points occur at nominal values of 
8, 20, and 250 Lbf (0, 20, and 250 Lbm in 1 g acceleration field). 

As expected, hand-finger combinations exhibit maximum dexterity at 
corresponding minimum force and power levels. Arm plus finger-lock 
combinations on the other hand, give maximum power and force with 
minimum dexterity* 



1. Movtutnt of th» Fingers with Defined Speed 

2. Movement of the Fingers With Defined Speed to * 

Defined Position 

3. Creeping With Oef ined/Spec if ied Force end Torque 
Limi ts 

<♦. Movement of the Fingers With Defined Speed to e Defined 
Position, Combinmb With the Exertion of e Defined Force 

5. Stopping the Fingers et Any Closing Distence. This 
Could Include Loceting the Hend Fingers Concentric 
With/ In Accommodetion to - en Object - Using Touch 
Sensors. 

6. Activetion of the Sensor System (Tactile and Nontactile) 

7. Deactivation of the Sensor System 

8. Transfer of the Sensor Data to the Robot Hand Controller 

Table 5 summarizes the eight primitive operations required for 
the robotic hand, which it should be remembered is part of the 
MMU, arm, hand - EVA Retriever system. Note that 

* The first five primitive operations ultimately make closed 
loop control of (1) Position, (2) Speed, and (3) Grasp force 
necessary . 

* Speed control can be realized via hardware. 

* Force and position are controlled by software - which im- 
plies the use of dynamics/dynamic models of the robotic 
hand, arm, MMU system. 

* For control of the (grasped/manipulated) object with the 
robotic hand it is necessary to use both tactile and non- 
tactile sensors. 


Dynamics 

Dynamics can be considered to be made up of the two subareas: 
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kinematics and kinetics. As applied to robotic hands and manipula- 
tors, kinematics is concerned with the <a) Direct mapping of joint 
coordinate motion to link Cartesian coordinate motion, and <b) In- 
verse mapping of link Cartesian coordinate motion to joint coordi- 
nate motion. Here the emphasis is on the hand/manipulator motion 
without regard to the forces and torques causing the motion. Hand/ 
manipulator kinematics involves the position, velocity, and accele- 
ration aspects of the motion in link Cartesian coordinate and joint 
coordinate spaces . 

Kinetics as applied to robotic hands and manipulators is con- 
cerned with the time rate of change of the Cartesian configuration 
of these robotic systems as a function of the applied joint torques 
and forces. Here the Newton-Euler or the Lagrangian forms of the 
equations of motion can be used to define the dynamic response of 
the hand/manipulator linkage system to input joint forces and 
torques. Once the equations of motion have been developed, the main 
problem is to determine, i.e., identify those design parameters and 
force/torque terms which are important in controlling the Cartesian 
space motion of the hand/manipulator system. Thus, dynamics is im- 
portant to the design and the control of the dextrous hand plus arm 
system. It can lead to better nonlinear and linearized models for 
simulation tools in^task planning and control strategy implementa- 
tion. This is especially true for the multi-fingered hand plus 
multi-armed EVA Retriever systems. This section of the report will 
concentrate on the kinetics aspects of dynamics. 

Table 6 summarizes a nonlinear - recurrence formulation of the 
Newton-Euler equations for a hand manipulator system. This is the 
Luh, Walker, Paul formulation. Table 7 defines the nomenclature used 
in Table 6. Details can be found in Luh et al 1983, Lathrop 1985, 
and Murray and Newman 1986. The corresponding linearized - recursive 
formulation of the Newton-Euler equations is given in Table 8. The 
nonlinear Newton-Euler dynamic equations can be used to generate 
feedforward control torques/forces for the hand plus arm system. De- 
pending upon the computer processing power available, the nonlinear 
dynamics calculations can be done either offline or online. Multi- 
processor implementation of the latter is required for robust 
control in real-time situations. 

The linearized - recursive dynamic equation models can be used 
for (a) Developing op t imal /more-op t imal robot hand, etc. designs, 

(b) Online/real-time identification of unknown object inertia and 
robot drive train, etc. characteristics, and <c) Implementing obser- 
ver synthesis giving robust adaptive control. 

Implementing the dynamic formalisms given above can lead to 
direct concern with the following bottlenecks - i.e., operation 
count and memory impediments to real-time dynamic models. The compu- 
tational load problem of many advanced control schemes lies in de- 
veloping an efficient inverse dynamics algorithm. Such algorithms 
can compute the actuator torques/forces required to produce the de- 
sired joint accelerations (a la inverse kinematics) for a given set 
of link Cartesian displacements. Such algorithms must be evaluated 
by the control computer at least 100 times per second for the hand/ 
manipulator control scheme to be effective. 

Here it is important to exploit the reduction of operation 
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count/time of calculation as a function of the number of degrees of 
the hand/manipulator robotic system. Such reductions arise from the 
geometry and hierarchical design structure (as, e.g., open tree and 
constrained loop - connectedness partitioning) of the smart hand 
plus arm robotic system. 

Horak 198^ has considered the exploitation via the arm, wrist/ 
hand partitioning of the relatively simple geometry of arm - manipu- 
lator systems having 4 to 7 links. Lathrop 1985 has treated the ex- 
ploitation of parallelism in manipulator dynamics. Table 9 summa- 
rizes his results. It also shows the evolution toward reduced op- 
eration (addition, multiplication) and machine cycle time. Here as 
with the forward/backward recurrence schemes in Tables 6, 8, linear 
operation counts are possible. However by exploiting the space-time 
parallelism (a) Order log(NDOF) operations and <b) Systolic 3 vector 
adds plus 1 vector multiply implementations are also possible. 
Lathrop’s work indicates that such efficiencies obtain for both the 
nonlinear and the linearized dynamic equation forms. 

As far as the control of object motion for manipulators is con- 
cerned, Kerr and Roth 1986 have analyzed the inverse dynamics prob- 
lem for multi-fingered hands. They give a general formulation to 
evaluate the finger, etc. torques/f orces required for the redundant 
object plus multi-finger linkage system. The author has considered 
the degree of freedom reductions possible if position and velocity/ 
slip sensors are used with each finger. Details will be available in 
an extended version of this report. 

Sensors and Sensing Systems 

Sensors and sensing systems are the beginning elements or com- 
ponnents in perception. They are of prime importance in performing 
the observation function - for the intelligent, controlled interac- 
tion of a robotic system with its environment. The primary sensors/ 
sensing systems considered for use in general space robotics can be 
summarized as (1) Vision, (2) Tactile, (3) Proximity, (A) Force, (5) 
Position, and (6) Velocity. 

The smart, dextrous hand plus arm plus MMU - EVA Retriever sys- 
tem needs a variety of sensors. Hu 1 t i -sens i ng is necessary in order 
for the Retriever robotic system to adapt to disturbances and unpre- 
dictable changes in (a) Its EVA - space environment, and (b) Itself 
in interacting with that environment. Here the Retriever robotic 
system will use (1) External sensors as, e.g., visual, infrared - 
light, solid-state CCD cameras and touch sensors; and (2) Internal 
sensors such as optical, magnet ic- joint encoders, and Hall-effect 
based, joint torque/force sensors. In this vein, Table 10 summarizes 
the sensor environment of the robotic hand, etc system. Figure 7 
gives a corresponding representation of a robotic manipulator /hand 
system which is provided with the senses of feeling (internal sens- 
ing) and sight (external sensing). Figure 7a also gives an opera- 
tional diagram for the (1) Scene recognition, (2) Signal/image 
processing - programs, and (3) Grasp program for the manipulator 
hand. Figure 7b depicts the teaching-phase use of the sensed infor- 
mat ion . 

In the smart, dextrous robotic hand plus arm system, sensors can 
measure triaxial force at the finger/hand contact points with an ob- 
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ject CStocic et al 19963. The object will be grasped/manipulated - 
as, e.g., while either in motion during a carry/transport operation 
or in contact with the working environment, as in an assembly task. 
In this context, sensing can allow the robotic system to identify 
and then compensate for - uncertainties in the object inertia rela- 
ted - load and torque character istics CNeuman, Khosla 1986, Seraji 
1997, Stephenko 19973. 

For sensor -based , effective task planning and control opera- 
tions, the following dynamic world data are used for trajectory 
calculations: (1) Position and orientation of the retrieved object, 

(2) Distances, (3) Diameters, (4) Geometry of the retrieved object, 
(5) Path of the object (position, velocity), and (6) Contours. 

Vision (visual light and infrared) sensors provide such data for the 
EVA Retriever robotic system. Figure 8 gives a block diagram for a 
t ime-of-1 ight laser scanner. Figure 9 depicts the basic geometry for 
a triangulation type laser scanner. These sensor systems can be used 
in mid-field to farfield vision systems to obtain rest of the 
dynamic world data discussed above. Up close - that is, in the near 
field of the robotic hand between the finger - arrays of infrared 
sensors can be used to sense object approach/proximity and 
orientation. Figure 10 depicts this use of infrared receiver, 
transmitter arr ays • _ 

Smart hand tactile sensing is required when the intelligent EVA 
robotic retriever system must: (a) Verify capture and stable 

grasping of an object, and (b) Perform delicate manipulate/assembly 
operations. It should be noted that the tactile sensors can make 
many manipulate/assembly etc. tasks simple which are very difficult 
to accomplish visually. 

Tactile-sensing reduces to the following three fundamental 
sensing operations: 

(1) Joint forces sensing - ie, sensing the forces applied to the 
joint of the robotic hand, wrist, and arm manipulator). 

(2) Touch-sensing of the pressures applied at important contact 
points on the finger/hand surface. 

(3) Slip-sensing of movement/incipient movement of the object 
while it is being grasped. 

Joint forces are typically sensed using arrays of strain gages 
(strain-gage wrist force sensor) or Hall effect sensors, (fingers, 
etc. of the UTAH/MIT dextrous hand). Vibration or relative 
displacement sensors are used to detect object slip CStaugard 19873. 

The sense of touch is used to generate the finer detail data 
required to describe the interaction between the robotic hand and 
the object or workpiece. This is because most of the 

manipulative/assembly action occurs at the contact interface between 
the hand and the object. A robot touch sensor should duplicate the 
object recognition, and position and orientation determination 
functions of the human skin/nerve ending system. Usually 
temperature sensing per se is not required. Table 11 summarizes the 
design specifications/characteristics of a representative tactile 
sensor. Figures 11 and 12 give schematic repr esent at i ons of the 
Hillis conductive rubber resistance change, and the Raibert and 
Tanner VLSI tac t i 1 e/ touch sensor array designs, respectively. 

Acoustic pulse through tuned elastomer array designs from Bonne- 
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PIOUM /2 PHYSICAL STRUCTURE OP THE RAIBERT AKO TANNER 
FIQUW/A. SENSOR DESIGN. 

Xere a u-Tthick sheet op PRESSURE-SENSITIVE 
CONDUCTIVE PLASTIC (DYNACIOR B) IS PLAC^ IW 
CONTACT VITJI A VLSI WAFBW ^ ^^JOgAT*® 
CIRCUIT. THE WAFER IS COHFRWEB OP A TWO- 
OXIVNSIONAL ARRAY Of CELLS* EACH Of DIf“*“ 

1,6 s 0.9 m. 
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TABLE J/ SUNMRV ON THE CHARACTER I ST ICS /DC SI ON SFCCIFICA- 
"• TIONS OF A REPRESENTATIVE TACTILE TRANSDUCER. 


1. An Array Consisting of «« Loose 10 X 10 Force- 
Sons 1 09 Clements on a 1 sp-in Surface. This 
Corresponds to a Human Fingertip. 

2. Each Element Should Have e Response Time of t to 
10 meec. This should Be Closer to 1 msec. < Corres- 
ponds eo 300 Hr Via Nyquist Sampling Criteria). 

3. Threshold Sensitivity for tne Clements Should Be 
Alpha X l g .With the Upper Limit of the Force 
Rang# at Alpha X lOOO g . Here Alpha Is e Factor 
Appropriate to the Space Environment (0 << Alpha 
< 1 ). 

A. The Elements Do Not Need to Be Linear. However. 
They Must Have Low Hyeseresie. 

3. The Sk ini ike Material Must Be Roeust. That Is.. It 
Must Stand Up Hell to the Harsh Space Environme n t 
and Be *nodularly* Replaceadla. 




FACTORS TO SB CM1MMD «v A L A NO MF R E FOR A 
VISION AND ISJLTISENSQW SVSTCh. 


1. I eage/ Signal Preprocessing ( Including Pgstsratien, 


Enhancement. Etc.) 

• Instructions Ter Com p o n en t ‘Visual* ane hultt- 

s en ss r Systems 

• Frscmssing sf All ‘Wise!' or Array Ele m e n t Level 
Infersatlen 

• Feral lei Lecal Free ess ing Ooeratlon 

• Efficient Staring of nultieimenstensl 
(SO.3Q.Ctc . I Structures Oata 

«. Image/Signal Extraction (F«atur» Extraction. OOject 
Aecegnl tlsn Inducing KiltlSenser Fwatoni 

• Arithmetic. Oelay Operations 

• Statistical Omeratisns - Fusion of hultlSensor 
Information 

a Instruction* for the ‘Tmoch-In’ /Lesrning hoeo 


• Instruction* for Feature Definition 

• Quantitative Feature Extraction 
3. Image Analysis (Description) 

• Definition of Data Structures (Lists. Oraph*. 
Etc.) 

• Definition of 00)ect value Nelatiens CAesve' , 

* So lew’. ‘Left*. ‘Night* * Etc.) 

• Compo sition < Dec eases 1 t lent *f heistions 

• Knemlepge Acpu 1 r ament (KnmlMgo Acer et ten! 

a Nedel generation (Vie tepee trie, tv aha lie. CAD. 
Etc. Peer eemntet ions) 


0. 1 wa ge/ Signal Contest (‘Scene' Analysis. Incluaing 

Situation Assessment/ Informational u nemr etaneing > 

• Analysis Dasme tn Stares Knewieoge 

• Inference Mules 

• Wasson i ng ane Queries 


• KnewiePg* na n s g ame n t 


Mete tnat Faint* 3 snp ♦ Motivate the Cen*«ructlen of 
Symsa lie. Wule-Sasee Lsnpuage* Dertvee fr 9 m tne Weoulcs 
of Artificial Intel llgencs R esearch . 
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vile Scientific CAstle 1987] also look promising. 

In considering the use of sensors in effective, task planning 
and control strategies for an intelligent hand, etc. Retriever 
robotic system, the computer language used must be given great 
consideration. Table 12 gives the factors to be considered by a 
computer programming language for a vision and multisensor system. 
Here the four main areas of (1) Image/Signal Processing, (2) 
Image/Signal Extraction, (3) Image/Analysis, and <4) Image/Signal 
Context (Scene Analysis) are considered. Requirements in these 
areas drive the design specification features which must be offered 
in a multi sensor-based, intelligent control system. 

Retriever Robotic Control 

Intelligent, sensor-based control of the smart dexterous hand 
plus arm plus MMU components of the Retriever robotic system is of 
primary importance to its successful EVA function. Here the arm 
plus hand/manipulator tasks of the Retriever can be specified in 
Cartesian coordinates. As discussed in the previous report section, 
sensors perform the observation function. The measured internal 
variable for feedback control purposes are joint displacements and 
velocities. Thus, the goal or command state variables and these 
measured output variable quantities are in different coordinates. 
This means that control of the position and orientation of the arm 
and hand/manipulator system by actuators at the joints requires 
knowledge of the transformat ion between the Cartesian hand and joint 
space respresentat ions. 

Figure 13 gives a schematic representation of the smart hand 
prehension process as a feedback operation. In the system depicted 
desired hand behavior task commands are used in combination with 
global sensing to position the arm/hand system. At this level the 
hand mode is chosen and used to bring about grasp ing/ low-level and 
/or movement of the object. Sensor information is continually fed 
back to control finger and hand object position, velocity and 
contact force . 

Deep Knowledge Control 

In developing grasp and manipulate - “trajectory" control of the 
path of a retrieved object, or an object/robotic hand system in con- 
tact with the environment, the dynamic modeling and the sensing 
functions discussed previously can be exploited. The hand/manipula- 
tor dynamics can be defined in joint space coordinates as 

H q* + h = T ( 1 ) 

in which, q = Vector of joint d isp 1 acements d) as discussed 

previously . 

T = Vector of joint torques. 

H(q) = Manipulator inertia matrix. 
h(q, q, t) = Nonlinear term containing the centrifugal, Coriolis, 
friction, and gravitational forces/ torques . 

As discussed previously, sophisticated on-line computational 
strategies are required to compute the arm plus hand/manipulator 
dynamics for the EVA Retriever robotic system. In today’s arm plus 
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TABLE 


0 . 


SUmMV OP THE NECCSSARV FEATURES OF A 
MULT I PROCESSOR-BASED ROBOT CONTROLLER FOR 
THE EVA RETRIEVER. 


TA,LE /# 


BASIC COMPUTER ARCHITECTURE requirements - UNDER 
WHICH DEVELOPMENT and IMPLEMENTATION OF ThE ROBOT 
CONTROL SYSTEM SHOULD BE PERFORMED. 


1. Different Control Levels (Including Task 

Ac Co MO 1 1 . Opportunistic Scheduling) 

2. Distribution of tho Control Hlororcnv for the 
Robot Among High-Speed. 32 Bit Microprocessors 

3. Distributed System Oporstion 
(Nocssssry for Psrsllol Task Procsssing on 
Different Control Levels) 

k. Modular SyM M O trie Hardware Conf igurat ion 

3. Multiple Bus System 

*. fxpandabi 1 ity With No Need for Hardware or Software 
Reconf igurstlon 

7. Spec! el -Purpose Modules (Sensor Input/Output. 
Arithmetic. FFT * Interpolators. Kalman Filters 
for Observation and Control. Etc.) 

a. Parallel Task Decompositions IA La Brooks. Lozano- 
Perez) for Real-TiMe/Real-Wor id Problem Situations 


1. Clear, Well-Defined Separation of All Control LPvals 

2 . Modular Aren l tec ture Built-Up on tne Basis of a 
Symmetrically Distributed System 

3. standardized Interfaces Between the Control Modules 
(Hardware and Software) 

a. Transparency to the User at All Control Levels 
3. Defined Format and Standardized Protocols 

A. Multibus Systsm to Ensure Parallel Communication 

7. Hierarchically-Based, ’Decentralized' System Control 

B. Dynamic Reconfiguration for a (High Signal Communi- 
cation to Processing Power - A La Hypereube Type) 

Po lyprocessor Environment 


7. Handling of a World Model In Olobel M emory 


srtrtM 

UtmL 
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RE7RESEMTA7I ‘I >P 
OF A MOBILE S;2J7 
MODULES ( ‘STAFF’ 


:Hi TRADITIONAL DtCOiPCS I 
CONTROL SYSTEM INTO FUNC? 
OSGAN IZATICN ) 


«mh or r**/*no« 


K CLOSED-LOOP PERFORMANCE VERSUS VARIATION IN SYSTEM , STRUCTURAL 
9 9m PARAMETERS 
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FIGURE representation op a robot control system 

BASED ON TASK -ACHIEVING BEHAVIORS ( ’PROJECT 
(§ J ORGANIZATION ) 
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hand, etc. systems for the EVA Retriever the trend is toward mechan- 
ically "cleaner") more positive designs with fewer gear, etc. drive 
train components. This means that actuators, as, e.g., high torque 
motors are coupled directly or as closely as possible - to each 
joint in direct drive robotic system designs. Such designs have high 
mechanical stiffness, little or no backlash, and low friction. How- 
ever, they also can have higher sensitivity to external distur- 
bances, full link-to-link coupling, and nonlinear dynamics effects 
which are made worse by the high speeds which such systems can 
attain. These factors can increase the need for on-line computation- 
al dynamics and control. 

Controlling robotic system dynamics of the form of Eq . (1) usual- 

ly involves one of the three approaches: 

(1) Individual joint proportional , integral, derivative <PID) 
control - which (a) Ignores link dynamics, and <b) Uses 
local decoupled PID’s at each joint (ignores link 

coup ling). 

(2) Computed torque control - in which control torque T is de- 
fined using a structure identical to Eq . (1). That is, 

T = H u + h (2) 


Here the problem reduces to that of controlling the system 


Such control can be done using decoupled PID as per: 


u ■ v 

in which, 


- K V 


V = q> - 

KPi » ki^‘» KD^- PID coefficients which are 
positive and sufficiently large. 

) Robust Controller Design - as, e.g., using pole-placement 
modal control and gain scheduling in combined feedforward 
plus feedback control strategies CNorcross et al 1906, 
Seraji 1987, Stephenko 19873. Here the basic issue is how 
to minimize performance sensitivity to model model uncer- 
tainty, as, e.g., parameter uncertainty or inaccuracies in 
manipulator and object mass properties, torque constants 
of the actuators, friction of the drive train, unknown 
loads, etc. Model uncertainty can also encompass high-fre- 
quency unmodeled dynamics - such as structural resonant 
modes, sampling rates, and neglected time delays. 

» illustrates the idea of controlled system robustness. It 
>sed-loop performance versus the variation in system param- 
lis is done for different types of controlled dynamic system 
j from open-loop (no feedback control) to adaptive (model 
? , parameter estimation, etc. types), closed-loop control, 
'ant control of the EVA Retriever robotic system it should 
that there is an important tradeoff between (1) Speed, (2) 

J (3) Generality of application. This motivates the selec- 
two-level control structure as per: (1) Linear low level 


' K jr'-t| at 
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(inner loop) feedback control law, and (2) Generally nonlinear upper 
level (outer loop) feedforward control law. The outer loop optimizes 
the linear feedback control law parameters. This is done based upon 
the nonlinear equations of motion for the robotic system. 

Hierarchical Strategy and Intelligent Control 

In implementing control of the hand plus arm plus MMU comprising 
the EVA Retriever robotic system, it is important to consider the 
strategy /contro 1 architecture employed. Figure 15a gives a represen- 
tation of the traditional decomposition of a mobile robot control 
system into functional modules. This ,, staff ,, organization of the 
control system is inadequate for the real-time implementation on a 
multiprocessor of control for the EVA Retriever. Figure 15b is a 
representation of a multilayered robot control system based on task- 
achieving behaviors. This ’‘project 1 * organization of the control sys- 
tem is made up of hierarchically parallel task layers. It lends it- 
self to implementation on a mul t iprocessor based controller and 
hence shows great promise for real-time control of the complete EVA 
Retriever system CBrooks 19861. 

Basic intelligent control algorithms can be implemented using a 
parallel microprocessor (i.e., multiprocessor based) structure. Here 
such rule-based algorithms for MIMO ( mul t i - i nput , multi-output) sys- 
tems have the property of decomposing or decoupling the multivaria- 
ble control input into a set of si ng le— i nput , multi— output systems. 
Thus, this allows for a parallel, pipelined (i.e., systolic) struc- 
ture using a common rule base (as, e.g., with cloned CLIPS, etc.) 
that is easily implementable on an array of processors. 

Any discussion of smart robotic hand control would be incomplete 
without mentioning the possibility of using neural nets CLippmann 
19873 or generalized learning algorithms CMiller et al 19873. These 
can be used for multi-sensor pattern recognition functions and for 
the control of robotic hand/manipulator systems. Here the pattern 
recognition and control-learning schemes can be based solely upon 
observations of the input-output relationship for the system being 
controlled. Research work with Hopfield type neural nets [Freeman 
19873 used in solving optimization problems, indicates that control 
objectives can be included. The author suggests the formulation of 
a generalized Hopfield neural net structure. This would include 
optimal robotic controls imbedding - as a Hami 1 toni an/Lagrang i an 
form, augmented with state vector and control vector constraints. 

Multiprocessor-Based Robot Control 

The multiprocessor implementation of real-time intelligent con- 
trol of the hand plus arm plus MMU comprising the EVA Retriever is 
a function of such issues ass 

* Computational load balance 

* Tradeoffs between (a) Signal communication time, and 
(b) Processing time 

* Programming techniques - as a function of (a) Hardware/soft- 
ware architecture, and (b) Language environment 

* Effective raw processor speed, quantization, and memory 
ut i 1 i zat ion 

* "Impedance Match" with the problem formulation and algorith- 
mic structure and complexity. 
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Table 13 summarizes the necessary features of a multiprocessor- 
based robotic controller for the EVA retriever. The basic computer 
architecture requirements - under which development and implementa- 
tion of the robotic control system should be performed are given in 
Table 1^. Both tables emphasize f eatures/requi rements relating to 
doing parallel task processing on different control levels. 

Conclusions 

An investigation has been made of the basic issues and concepts 
relating to dynamics* sensing, and intelligent control for the dex- 
trous hand plus arm plus MMU system. This system defines the space- 
going components of the EVA Retriever robotic system. Specific 
attention has also been given to artificial intelligence, rule-based 
Expert Systems and the new area of Neural Nets. Based upon the 
research conducted, the author considers the following of prime 
importance: (1) Integrated dextrous hand plus articulated arm, 

mechanical and electrical drive system design, (2) Multisensor 
capabilities for position, veloc i ty ,- force/ torque , and slip/grasp 
stability, (3) “Standard 1 ' control and neural net observer synthesis 
for control purposes, and <*t> Multiprocessor-based implementation of 
real-time, on-line dynamics, robust /adapt ive control and hierarchal- 
ly-layered (Brooks arch i tec tur e ) - task planning. Specific recommen- 
dations are summarized in the next report section in terms of a 
research and development program plan. 

Recommendations 

This section of the report presents recommendations for the 
smart robotic hands plus arms plus MMU - EVA Retriever system. These 
recommendations are presented in the form of a research and develop- 
ment program plan. The R & D program plan gives activities that can 
be pursued on a one, two, and three year basis. A more complete 
version, broken down into specific research and development plans 
will be available in an extended version of this report. 

(1) Implementation of basic primitive operations for the 

robotic hands: (a) open-loop with force limit, and (b) 

Sensor-hand — low level (basic movement) and high level 
(position, force contact, and slip/grasp stability) 
contro 1 . 

(2) Implementation of task planner for six grasp and six basic 
manipulate robotic hand functions. 

(3) Neural Nets developmental work: (a) Testbed w.r.t. robotic 

hands applications (pattern recognition for rule-based 
systems, control primitives, basis for "common sense" 
reasoning, use in fuzzy/noisy situations), <b) Use with 

A . D . Little/Marcus hand - master system, (c) Developmental 
operating system, (d) Knowledge representation significance 
versus sentence- 1 i ke representat ions of knowledge, (e) 
Explanation of Neural Net reasoning and knowledge repre- 
sentat ion utility. 

(A) Development of multiprocessor, systolic - type transputer 
versions of CLIPS, Common LISP: (a) “Cloned" CLIPS, etc. 

architecture with “Guarded Horn Clause" resolution of 
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contention for system resources, <b) Interfaced with 
multiprocessor versions of C and FORTRAN. 

(5) Development of integrated AI/ES 8* NN plus digital signal 
processing system for using multisensor information. 

(6) Development of distributed operating system which is 
necessary for/mandated by - the need to do parallel task 
processing on different hierarchical control/task levels. 

<7) Development of ongoing testing and performance evalua- 
tion: (a) Prototyping tools as per (6) above, and (b) 

hardware, software AI/ES & NN controller testbed (hands 
etc.) for EVA Retriever (and Space Station intelligent 
control appl i cat ions. 
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